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I.  OBJECTIVES 


The  overall  objective  of  the  project  was  further  development  of  a 
model  (Arend,  1973)  describing  the  role  of  retinal  image  motion 
in  the  human  visual  system's  processing  of  edge  information  in 
patterns.  Several  lines  of  investigation  were  proposed, 
including: 


A.  Eye  Movements  and  Stabilized  Retinal  Images 


Recent  experiments  using  grating  patterns  held  stationary  on  the 
retina  have  raised  questions  concerning  the  role  of  retinal  image 
motion  in  spatial  pattern  vision.  The  fact  that  high  contrast 
gratings  remain  visible  when  stabilized  with  the  SRI  Double 
Purkinje  Image  Eyetracker  (Kelly,  1979)  has  been  interpreted  as 
meaning  that  the  human  visual  system  can  process  pattern 
information  in  the  absence  of  temporal  change  of  the  retinal 
image,  contradicting  previous  views.  This  issue  is  a  critical 
part  of  the  most  basic  understanding  of  human  pattern  vision. 
One  goal  of  the  project  was  stabilization  work  in  which  we  1) 
replicated  Kelly’s  basic  observations  of  stabilized  gratings  and 
2)  reinterpreted  all  grating  stabilization  data  in  light  of  new 
calculations  of  the  sensitivity  of  the  human  visual  system  to 
small  image  motion. 


B.  Spatial  Gradients  and  Integration  over  Edge  Information 


A  large  component  of  the  project  was  investigation  of  how 
information  from  sharp  and  shallow  spatial  gradients  of  intensity 
and  color  gets  assembled  into  a  stable  and  reliable  visual  array 
of  lightness  and  color.  Goals  for  this  portion  of  the  project 
were  1)  assembly  and  calibration  of  the  display  system  consisting 
of  minicomputer,  image  processor  and  color  video  monitor  2) 
software  development  for  displaying  patterns  and  controlling 
experiments  and  3)  experiments  on  gradient  illusions. 


C.  Lightness  and  Color  Constancy  in  Complex  Patterns 

The  third  major  goal  was  investigation  of  lightness  and  color 
constancy  in  complex  patterns.  One  of  the  properties  of  the 
model  is  encoding  of  information  about  relative  lightnesses  and 
colors.  Relatively  little  work  has  been  done  on  color  perception 
with  complicated  spatial  patterns.  Further  development  of  the 
model  requires  information  about  the  roles  of  several  parameters, 
including  complexity  (number  of  different  colors  under  single 
illuminant,  range  of  different  colors)  and  spatial  distribution 
of  reflectances  and  illuminants. 
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STATUS  OF  RESEARCH  EFFORT 
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A.  Stabilized  Retinal  Images 

Substantial  progress  was  made  in  evaluating  Purkinje  Image 
Eyetracker  stabilization  of  gratings.  The  principal  conclusions  I 

are: 


1)  Most  of  the  gross  form  of  Kelly's  grating  stabilization 
data  replicates  in  our  lab  using  a  similar  eyetracker, 
different  subjects  and  improved  methods. 

2)  Calculations  from  stabilized  grating  contrast 
sensitivities  show  that  the  P.I.  tracker  (in  fact,  probably 
no  existent  eyetracker)  can  eliminate  all  meaningful  retinal 
image  motion  and  therefore: 

a)  Residual  visibility  of  stabilized  objects  does  not 
necessarily  imply  that  the  visual  system  contains  mechanisms 
capable  of  responding  to  temporally  unchanging  inputs  and 

b)  Only  subjective  pattern  fading  and  disappearance  can  be 
relied  upon  as  a  criterion  of  stabilization  adequacy,  and 
then  only  with  qualification. 

In  light  of  current  evidence,  therefore,  it  is  likely  that  all 
pattern  information  is  derived  from  retinal  temporal  changes.  We 
therefore  must  have  a  model  like  that  under  investigation  here, 
describing  the  extraction  of  spatial  pattern  information  from 
temporal  information. 

A  paper  describing  our  stabilized  grating  experiments  and 
motion-sensitivity  calculations  was  published  in  the  Journal  of 
the  Optical  Society  of  America  A. 

B.  Spatial  Gradients  and  Integration  of  Edge  Information 

1.  Display  System.  During  the  first  year  a  display  system 
consisting  of  a  VAX  11/750  minicomputer,  an  Adage  3000  image 
processor  and  a  Tektronix  690  RGB  monitor  was  selected, 
purchased,  and  installed.  The  display  system  was  calibrated  in 
the  second  year  to  provide  accurate  specification  of  luminance 
and  chromaticity  over  the  full  output  range  of  the  monitor. 

The  spectral  emitances  of  the  red,  green,  and  blue  phosphors 
of  the  monitor  were  obtained  by  a  grating-monochromator 
multichannel  analyzer  and  the  CIE  chromaticity  coordinates  of  the 
phosphors  were  calculated  (fig.  1). 

Luminance  vs.  d  i  g  i  t a  1- inpu t-da ta  curves  were  obtained  for 
the  three  guns  singly  and  together  at  nine  screen  locations. 
Unlike  published  data  on  other  monitors  (Cowan,  1984)  the  curves 
for  all  three  guns  were  well  fit  by  a  single  power  function 
(after  multiplication  by  a  constant  equating  the  maximum  outputs 
for  the  guns).  Thus  the  outputs  can  all  be  linearized  with  one 
power  function.  The  function  in  use  linearizes  the  light  output 
to  better  than  one  percent  at  all  values  (fig.  2).  The  output  of 
the  phosphors  is  stable;  repeatability  is  excellent  from  week  to 
week . 


2 


Figure  1.  Relative  power  spectra  of  phosphors  of  Tektronix  690 
monitor.  Right  peak:  red  phosphor.  Middle  peak:  green  phosphor. 
Left  peak:  blue  phosphor. 


Fig.  2.  a)  Luminance  of  Tektronix  690  phosphors  as  function  of 
digital  data  applied  to  D/A  converters.  Scaled  to  maximum 
luminance  of  white  (all  three  guns  at  max i mum) =94.0  Cd/m2. 
Curves,  top  to  bottom:  white  (all  guns  on),  green,  red,  blue. 


b)  Curves  of  fig.  2a  each  scaled  to  its  own  maximum  luminance. 
Power  function  is  the  same  for  all  three  guns. 


c)  Luminance  curves  of  phosphors  after  linearization,  as 
function  of  image  data  level.  Each  curve  scaled  to  its  own 
maximum . 


2 .  Measurement  of  Gradient  Illusions.  The  first  step  in 
studying  gradient  Illusions  (Cra ik-O'Br ien-Cornsweet  and  related 
illusions)  was  development  of  satisfactory  techniques  for 
measuring  the  appearance  of  these  complex  spatial  patterns. 

We  explored  several  techniques  and  used  them  to  obtain 
more  quantitative  detail  than  previously  available  A  wide 
variety  of  shallow  gradient  patterns  yield  illusory  brightnesses. 
We  chose  initially  to  study  a  circular  ring  pattern  with  a  radial 
luminance  distribution  consisting  of  three  cycles  of  a  low 
contrast  sawtooth  (fig.  3).  Even  though  the  three  cycles  have 
identical  luminance  the  figure  appears  as  a  nearly  uniform 
brightness  central  disk  surrounded  by  two  nearly  uniform  rings  of 
increasing  (3a)  or  decreasing  (3b)  brightness  relative  to  the 
central  disk. 

The  subject  could  vary  the  luminance  of  a  small  square  in 
the  corner  ofthe  display  to  make  its  brightness  match  the  centers 
of  the  inner  and  outerbands  (fig.  3,  1  and  2). 

In  figs.  4  and  5  are  brightness  matches  from  two  subjects 
for  several  sawtooth  contrasts  in  each  polarity.  While  there  are 
important  differences  of  detail  the  subjects  generally  agree  that 
substantial  brightness  differences  occurred  at  all  contrasts. 
This  was  a  somewhat  surprising  result.  In  the  simplest  form  of 
the  model  the  illusory  brightness  differences  require  that  the 
shallow  gradient  be  below  threshold  and  not  perceived.  At  our 
lowest  contrast  the  bands  were  very  uniform  in  brightness  and  the 
edges  had  low  apparent  contrast.  At  the  highest  physical 
contrast  the  rings  had  pronounced  brightness  gradients  between 
high  contrast  edges.  It  was  initially  somewhat  surprising 
therefore  that  large  brightness  differences  occurred  even  in  the 
presence  of  the  visible  gradient.  In  an  attempt  to  quantify  the 
appearances  at  the  various  contrasts  the  subjects  were  asked  to 
judge  the  fraction  ofthe  ring  which  appeared  uniform  in 
brightness.  While  there  are  obviously  criterion  definition 
problems  with  this  task,  in  practice  the  judgements  were  not 
difficult  and  had  reasonable  error  bars.  Means  of  five 
judgements  are  shown  in  figs.  6  and  7.  Both  subjects  judged  the 
lowest  contrast  patterns  to  have  only  narrow  regions  of 
nonuniformity  adjacent  to  the  contours.  At  the  highest  contrast 
both  saw  brightness  gradients  over  most  of  the  ring,  but  RG 
adopted  a  less  strict  criterion  than  LA. 

Upon  closer  consideration  there  are  two  simple  possible 
explanations  for  the  brightness  differences  at  the  highest 
contrasts:  1)  Even  though  less  of  each  ring  appears  uniform,  the 
uniform  portion  spans  a  greater  luminance  range  due  to  the  higher 
physical  contrast.  2)  The  threshold  for  gradient  need  not  be  a 
step  function  wherein  increases  of  luminance  gradient  change 
abruptly  from  no  visibility  to  weight  equal  to  that  given  steep 
gradients;  a  more  reasonable  function  would  be  sigmoid  with 
physical  gradients  passing  gradually  from  no  representation  of 
shallow  gradients  through  progressively  greater  weights  for 
steeper  gradients.  While  the  second  option  seems  likely,  the 
data  in  figs.  4-7  are  also  consistent  with  the  first. 

The  graded  threshold  account  is,  however,  supported  by  a 
further  experiment.  Patterns  with  the  radial  luminance  profiles 


Figure  3.  Luminance  and  brightness  as  a  function  of  radial 
distance.  Inset:  display  configuration.  Left:  luminance  along 
radius  of  inset  (zero  *  center).  Right:  sketch  of  brightness 
distribution  along  radius  of  inset  pattern.  Subject  adjusted 
luminance  of  rectangle  in  inset  pattern  to  match  brightness  at 
points  1  and  2. 

Figure  4.  Brightness  matches  for  patterns  of  fig.  3  as  a 

function  of  pattern  contrast  ( =  ( L  m a x “ Lm i n> / < Lm a x  +  Lm  i  n5  > * 
Circles,  top:  point  1,  top  configuration  of  fig.  3.  Ci'ri  les, 
bottom:  point  2,  top  configuration.  Squares,  top:  point  2, 
bottom  configuration  of  fig.  3.  Squares,  bottom:  point  1, 
bottom  configuration.  Subject  LA. 

Figure  5.  Same  as  fig.  4,  subject  RG . 

Figure  6.  Estimates  of  percentage  of  width  of  band  which 
appeared  uniform  in  brightness  as  a  function  of  pattern  contrast. 
Patterns  of  fig.  3,  top  configuration.  Circles:  outer  band. 
Squares:  inner  band.  Subject  LA. 

Figure  7.  Same  as  fig.  6,  subject  RG. 


of  fig.  8  have  no  subthreshold  gradients  if  the  small  steps  are 
detectable.  Nevertheless,  for  patterns  with  many  small  steps  per 
ring  there  is  a  clear  brightness  difference  between  the  bands. 
In  fig. ,9  are  brightness  matching  data  from  two  subjects  for  5-11 
steps  per  ring.  In  all  the  stimuli  the  small  steps  were  visible. 
No  brightness  differences  occurred  for  few  steps,  but  clear 
differences  occurred  at  9  and  11  steps.  The  brightness 
differences  in  fig.  9  clearly  indicate  that  the  sum  of  the  small 
brightness  steps  within  the  rings  did  not  equal  the  sum  of  the 
large  brightness  steps  between  rings.  We  therefore  conclude  that 
the  threshold  for  spatial  gradient  is  not  abrupt  but  graded. 
More  detailed  experiments  will  allow  determination  of  the  form  of 
the  weighting  curve  transferring  luminance  gradients  to 
brightness  gradients. 

3.  Gradient  and  Curl  A  major  issue  proposed  for  second  and  third 
year  study  was  inconsistent  integrals  in  two  dimensional 
applications  of  Land  and  McCann's  (1971)  and  Arend's  (1973) 
essentially  one-dimensional  models.  The  problem  is  illustrated 
in  fig.  10.  According  to  both  models  the  brightness  of  B 
relative  to  that  of  A  is  obtained  by  the  visual  system  by  taking 
the  gradient  of  log  retinal  illuminance,  setting  all  gradients 
below  some  threshold  to  zero  and  integrating  over  the  resulting 
distribution.  Explicitly  in  Land  and  McCann's  model  and 
implicitly  in  Arend's  the  differentiation  and  integration  are 
done  along  arbitrarily  chosen  curves  between  A  and  B.  The  models 
make  the  correct  prediction  along  the  straight  line  joining  A  and 
B  in  fig.  10.  The  shallow  gradient  is  below  threshold  so  the 
only  derivatives  going  into  the  integral  are  the  downward  steps 
at  the  contours,  indicating  that  B  is  darker  than  A.  Along  the 
path  crossing  the  outer  boundary,  however,  we  get  a  different 
answer.  There  is  no  change  between  A  and  the  outer  boundary,  a 
downward  step  of  known  magnitude  to  the  background  luminance,  no 
change  over  the  background  segment,  an  upward  step  on  crossing 
back  into  B's  band  equal  and  opposite  to  the  initial  crossing 
into  the  background,  and  no  change  between  the  outer  boundary  and 
B.  The  sum  of  these  derivatives  is  zero  indicating  that  A  and  B 
are  equal  in  brightness. 

These  inconsistent  integrals  will  occur  with  any  model 
which  accounts  for  gradient  illusions  by  taking  derivatives  or 
differences,  thresholding,  and  then  summing  or  integrating.  This 
includes  second-derivative  models  like  Horn  (1974)  and  Mart's 
(1974).  In  all  cases  the  presence  of  path-dependent  line 
integrals  means  there  is  no  true  two-dimensional  integral  and 
some  special  process  must  be  proposed  for  resolving  the 
inconsistencies  (unless  one  wishes  to  propose  that  the  appearance 
of  such  patterns  is  unstable  or  multistable,  changing  over  time, 
or  perhaps  beyond  description  at  any  given  time). 

Not  all  patterns  produce  inconsistent  integrals  in  the 
models.  The  radial  sawtooth  distributions  of  fig.  3,  for 
example,  produce  no  inconsistent  integrals.  All  paths  between  a 
point  in  the  inner  ring  and  a  point  in  the  outer  ring  cross  the 
same  subthreshold  and  supr a thr esho Id  gradients.  It  seemed 
possible  that  distributions  with  inconsistent  integrals  might 
produce  smaller  illusory  brightness  differences  and  larger 
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Figure  8.  Cube  root  of  luminance  as  function  of  radial  position. 

Figure  9.  a)  Brightness  matches  of  centers  of  three  bands  of 
pattern  of  fig.  8  as  function  of  pattern  contrast  (same 
definition  as  fig.  4).  Top  curve:  inner  band.  Middle  curve: 
middle  band.  Bottom  curve:  outer  band.  Subject  AR. 


b)  Same  as  fig.  9a,  subject  LA. 


brightness  gradients  than  consistent  patterns.  To  test  this 
hypothesis  we  matched  brightnesses  in  radial-sawtooth  disks  (see 
fig.  4)  and  radial-sawtooth  half  disks  (fig.  11).  The  latter 
are  merely  curved  versions  of  the  pattern  in  fig.  10  and  have  ( 

the  same  inconsistent  integral  problems.  Data  from  two  subjects 
are  shown  in  figs.  12  and  13.  As  hypothesized  the  half-disk 
brightness  difference  (and  hence  the  size  of  the  illusion}  is 
consistently  smaller  than  for  the  full-disk  for  both  subjects. 

The  difference  is  less  pronounced  for  RG  than  for  LA,  and  j 

background  luminance  had  a  larger  effect  on  LA's  half-disk  data  I 

than  RG's.  j 

Analysis  of  inconsistent  integral  problems  led  us  to  two 
new  paradoxical  patterns,  the  circumferential  sawtooth  pattern 
and  the  drifting  sawtooth  illusion. 

As  noted  in  the  original  proposal,  one  way  of  resolving 
the  problems  in  the  integration  is  to  perceive  brightness 
gradients  which  reduce  or  remove  the  curl  responsible  for  the 
inconsistent  integrals,  i.e.,  essentially,  lower  one's  threshold 
for  the  spatial  luminance  gradients.  While  no  quantitative  data 
have  yet  been  collected  documenting  the  appearance  of  the  full 
and  half  ring  patterns,  their  appearances  are  consistent  with 
this  type  of  solution.  Brightness  gradients  are  much  more 
pronounced  in  the  half-ring  patterns  than  in  the  corresponding 
full-ring  patterns. 

There  is,  however,  at  least  one  other  method  of  resolving 
the  problem.  The  offending  curl  occurs  where  the  border  with  the 
background  slices  across  the  subthreshold  luminance  gradient  as, 
for  example,  at  the  top  and  bottom  of  fig.  10.  If  the 
integration  is  carried  out  only  over  areas  which  do  not  cross 
this  border  there  are  no  inconsistent  integrals.  Thus  the 
problem  could  be  dealt  with  by  segmenting  the  visual  field  into 
separate  areas  of  integration,  each  internally  consistent.  The 
visual  problem  then  reduces  to  combining  the  output  of  the 
separate  integrations  to  give  a  brightness  distribution  extending 
over  the  entire  visual  field.  This  segmentation  could  resemble 
the  segmentation  required  for  veridical  perception  of  areas  under 
very  different  illuminations. 

Some  evidence  that  the  visual  system  is  sensitive  to  the 
geometrical  relations  among  subregions  of  the  image  comes  from 
observations  of  "circumferential  sawtooths",  displays  with  a 
sawtooth  luminance  distribution  around  a  circumference  rather 
than  along  a  radius  (fig.  14).  In  this  distribution  a  line 
integral  extending  from  point  A  around  the  circumference  back  to 
A  is  not  zero  (indicating  that  A  is  brighter  than  A  or  that  A  is 
darker  than  A,  depending  on  the  direction  of  rotation). 

Visually  this  pattern  is  unstable  (or  possibly  multistable)  with 
the  brightness  distribution  varying  from  moment  to  moment, 
depending  upon  such  factors  as  eye  movements  and  point  of 
fixation.  Two  adjacent  sectors  frequently  look  different  in 
brightness  and  relatively  homogeneous  within  sectors  (though 
never  as  homogeneous  as  in  the  bands  in  fig.  3  even  when  the 
luminance  gradient  is  less).  The  other  two  sectors,  however, 
are  nonuniform  and  their  brightness  relative  to  the  other  three 
sectors  remains  vague,  even  under  close  attention.  If  one  sector 
is  now  replaced  by  the  dark  background  there  is  still  curl  at  the 
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Figure-  10.  Schematic  of  integrals  computed  in  brightness  models 
along  various  paths  through  two  sawtooth  luminance  patterns.  a) 
Left  panel:  Linear  sawtooth  pattern.  Right  panel:  Sketch  of 
integral  of  thresholded  derivative  along  paths  1  and  2  between 
points  A  and  B.  b)  Left  panel:  Radial  sawtooth  pattern.  Right 
panel:  Sketch  of  integral  of  thresholded  spatial  derivative  of 
luminance  along  paths  3  and  4  between  points  C  and  D.  Shallow 
luminance  gradient  is  below  threshold,  abrupt  steps  are  not. 

Figure  11.  Display  for  brightness  matches  to  half  of  radial 
sawtooth  pattern.  Subject  adjusts  luminance  of  rectangle  to 
match  brightness  of  center  of  inner  ring  or  outer  ring. 


Figure  12.  Brightness  matches  of  centers  of  rings  of  radial 
sawtooth  luminance  patterns  as  function  of  luminance  of  surround 
(Lmax=94.0  Cd/m2).  a)  Complete  pattern.  Squares:  inner  ring. 
Circles:  outer  ring.  b)  Half  pattern.  Squares:  inner  ring. 
Circles:  outer  ring.  Subject  LA. 


Figure  13.  Same  as  Fig.  12,  subject  RG. 


Figure  14.  Luminance  as  a  function  of  angular  position  in 
annular  circumferential  sawtooth  pattern.  Dashed  line:  path  of 
problematic  integral  of  thresholded  spatial  derivative  of 
luminance  in  brightness  models.  Shallow  gradient  within  sectors 
is  below  threshold,  abrupt  steps  are  not.  Thus  integral  after 
360°  counterclockwise  rotation  is  sum  of  four  downward  steps, 
indicating  that  brightness  of  A  does  not  equal  brightness  of  A. 

Figure  15.  Sketch  of  truncated  circumferential  sawtooth  pattern. 

Figure  16.  CIE  diagram  indicating  Red/Green  isoluminous  gratings 
of  saturation  CSF  experiment.  Closed  curve:  spectrum  locus. 
Triangle:  color  space  of  Tektronix  monitor,  corners  are  phosphor 
loci.  Upper  point:  experimentally  determined  unique  green. 
Lower  point:  Dgggg  wh*te  monitor.  G ratings  were  formed  by 
modulating  sinusoidally  as  indicated  in  the  figure  along  the  line 
passing  through  unique  green  and  Dgggg. 

Figure  17.  Logarithm  of  inverse  of  excitation  purity  of  green 
peak  of  just  detectable  isoluminous  chromaticity  grating  as 
function  of  spatial  frequency. 

Purity  =  (green  peak  -  ■  Dg  5Q  Q.)  /  (5 1 0  nm  -  Dggg) 


inner  and  outer  borders  of  each  sector  (fig.  15).  Nevertheless, 
the  three  remaining  sectors  immediately  appear  uniform  and 
different  in  brightness. 

We  have  also  discovered  a  remarkable  illusion  in  which 
stripes  successively  drift  onto  the  display,  each  stripe  darker 
than  the  previous,  but  with  no  change  in  the  overall  brightness 
of  the  display.  Two  cycles  of  a  low  contrast  luminance  sawtooth 
initially  fill  the  screen,  appearing  quite  homogeneous  with  the 
left  brighter  than  the  right.  The  entire  pattern  is  then  slowly 
drifted  to  the  left  with  new  cycles  of  sawtooth  appearing  on  the 
right  edge  to  replace  the  portions  disappearing  at  the  left. 
Each  cycle  as  it  appears  is  darker  than  those  to  its  left.  Under 
passive  viewing  there  is  no  obvious  change  in  the  brightness  of 
the  band  as  it  moves  across  the  screen,  giving  the  overall 
impression  that  darker  bars  are  being  added  to  the  screen.  It  is 
only  with  mental  effort  that  one  notices  that  the  overall 
brightness  of  the  screen  is  not  changing.  Under  careful  scrutiny 
the  brightness  of  the  individual  cycle  can  be  seen  to  increase 
during  its  traverse. 

These  experiments  with  inconsistent  integral  patterns 
provide  further  demonstrations  that  the  visual  system  represents 
patterns  not  in  terms  of  local  luminances  or  luminance  ratios, 
but  in  terms  of  relatively  global  integrals  over  spatial 
derivative  information. 

C.  Color  Constancy 

Color  constancy  has  been  attributed  to  three  distinct 
mechanisms:  adaptation,  edge-ratio  normalization,  and  perceptual 
processes  such  as  discounting  the  illuminant. 

Clearly,  color  constancy  may  partly  result  from  adaptation, 
whereby  the  sensitivities  of  the  chromatic  mechanisms  of  the 
visual  system  change  over  time  in  response  to  the  changed 
illuminant.  Such  processes  have  been  modelled  by  the  Von  Kries 
coefficient  law. 

Constancy  may,  however,  also  stem  from  simultaneous 
mechanisms,  such  as  normalization  within  neural  edge-ratio 
computations  like  those  of  the  Arend  model  or  Land's  retinex 
theory  which  operate  independently  of  temporal  (fast  or  slow) 
adaptation.  The  empirical  foundation  for  theories  of 
simultaneous  color  constancy  is,  however,  rather  sparse. 

Finally,  in  the  Helmholzian  tradition,  color 
constancy  may  also  be  due  to  'discounting  the  illuminant.'  In 
this  case  the  local  hue,  saturation  and  lightness  are  affected  by 
a  change  of  illuminant,  but  the  apparent  surface  color  remains 
constant  due  to  accurate  perception  of  the  illuminant  change. 

We  conducted  experiments  to  examine  the  relative 
contributions  of  the  latter  two  mechanisms  to  color  constancy. 
Our  subjects  viewed  computer  simulations  of  colored  paper  arrays. 
A  standard  patch  of  colored  paper  was  displayed  under  one 
illuminant  and  a  test  patch  under  a  different  illuminant.  The 
subject  was  asked  either  to  adjust  the  test  patch  to  match  its 
hue  and  saturation  to  those  of  the  standard  patch  (hue  match)  or 
to  adjust  the  test  patch  to  look  as  if  it  were  "cut  from  the  same 
piece  of  paper"  as  the  standard,  i.e.,  to  match  its  apparent 


surface  color  (paper  match).  The  two  tasks  were  performed  with 
two  different  spatial  paper  arrays. 

A  number  of  authors  have  argued  that  color  constancy 
depends  upon  the  complexity  of  the  scene.  Calculation  of  the 
unknown' i 1 lum inant  and  unknown  surface  spectral  reflectances  from 
the  retinal  image  may  strongly  depend  upon  the  number  of 
different  color  patches  viewed.  To  examine  this  hypothesis  we 
used  cente  -surround  arrays  (two  surfaces)  and  complex  arrays  (32 
surfaces)  (j’g.  16). 

Observers  matched  patches  (simulated  Munsell  papers)  in  two 
simultaneously-  presented  c  o  mp  u  t  e  r -c  on  t  r  o  1 1  ed  displays,  a 
standard  array  presented  under  6500  K  illumination  and  a  cest 
array  under  4000  or  10000  K.  The  adjusted  patch  was  surrounded 
by  a  single  color  (annulus  display)  or  by  many  colors  (mondrian 
display).  Observers  made  either  hue  and  saturation  matches,  or 
’paper’  matches,  in  which  the  subject  was  asked  to  make  the  test 
patch  look  as  if  it  were  cut  from  the  same  piece  of  paper  as  the 
standard  patch. 

Results  for  the  annulus  condition  are  shown  in  CIE  (x,y) 
coordinates  in  Figure  17.  The  stimuli  are  plotted  in  the  same 
fashion  in  each  panel,  with  the  (x,y)  coordinates  of  the  6500  K 
standard  patches  that  were  matched  represented  by  circles. 
Coordinates  of  patches  under  4000  K  and  10000  K  are  indicated  by 
squares  and  triangles,  respectively.  The  mean  chromatici ties  set 
by  the  observers  are  indicated  by  closed  symbols  with  error  bars 
of  +/-  one  standard  error.  The  open  symbols  indicate  the 
chromaticity  of  the  paper  being  matched  under  the  test 
illuminants.  In  this  representation  of  the  data,  perfect  color 
constancy  would  occur  if  the  subject  set  the  test  patch 
chromaticity  to  the  chromaticity  the  standard  patch  would  have 
under  the  test  illuminant,  i.e.,  if  open  and  closed  symbols 
coincided.  Results  for  the  hue  match  are  shown  on  the  left  of 
Figure  17,  and  those  for  the  paper  match  on  the  right.  The  paper 
matches  show  quite  good  color  constancy  for  most  of  the  test 
patches,  although  the  shift  is  typically  slightly  erroneous  in 
magnitude  or  direction.  The  hue  match  data  show  much  less 
constancy  by  comparison;  the  data  depart  much  less  from  the  6500 
deg  chromaticity  being  matched,  though  the  small  shifts  obtained 
are  typically  in  the  general  direction  of  constancy.  Similar 
results  are  shown  for  the  mondrian  patterns  in  Figure  18.  As 
with  the  annuli,  the  hue  matches  shifted  substantially  less  than 
required  by  color  constancy. 

In  summary,  we  found  little  simultaneous  color  constancy  for 
hue  and  saturation  for  any  of  our  spatial  configurations,  when  we 
asked  for  direct  hue  and  saturation  matches.  The  4000  K  and 
10000  K  test  illuminants  were  always  easily  discriminated  from 
the  6500  K  standard  display  and  from  each  other.  All  of  the  test 
pattern's  hues  shifted  systematically  from  those  of  their 
standard  pattern  counterparts,  i.e.,  there  was  a  substantial 
preservation  of  illuminant  information. 

Pattern  complexity  had  little  effect  on  the  amount  of 
simultaneous  color  constancy.  The  hue  matches  in  the  mondrian 
condition  showed  no  more  deviation  from  the  6500  K  chromaticity 
point  than  in  the  annulus  condition. 

These  experiments  do  not  rule  out  the  possibility  that 
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shallow  chromatic  illumination  gradients  may  be  unperceived  or 
und e r we i gh t ed  perceptually,  producing  partial  or  full 
simultaneous  color  constancy  for  hue  matches  in  such  scenes. 

Under  our  viewing  conditions  the  illumination  difference  was 
always  clearly  perceptible.  We  therefore  reject  any  model  which 
inflexibly  discards,  through  some  normalizing  process, 
information  about  abrupt  illumination  changes  within  a  single 
scene.  The  fact  that  humans  can  compute  reflectance  information 
while  retaining  some  illumination  information  indicates  that  the 
visual  system  includes  a  process  capable  of  parsing  retinal 
illuminance  changes  into  overlaid  illumination  and  reflectance 
gradient  fields.  Further  experiments  will  be  required  to 
delineate  the  responsible  mechanisms. 
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